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Collecting User Responses over a Network 

Reference to Related Applications 

This application claims priority to co-pending U.S. 
Provisional Application Serial No. 60/259,848, filed December 
22, 2000, and entitled "Polling Systems, Methods, and Computer 
Programs". This application is incorporated by reference 
herein, in its entirety. 



Background 

Polling organizations, such as Gallup®, have developed a 

ii; number of techniques for gauging public opinion. For example, 

O 

O polling organizations commonly question people on the street, 

^15 phone people at home, mail questionnaires, and so forth. Most 

fU. people are familiar with polls that ask voters to identify a 

2 candidate or a position that they favor. Though their polling 

*. efforts typically do not make headlines, commercial businesses 

Hi also use polling techniques to discover consumer preferences 

1*20 regarding products, product names, prices, and so forth. 

ri 

Summary 

In general, in one aspect, the disclosure describes a 
method of collecting user responses to questions over a network. 

25 The method includes receiving from different network computers 
different sets of data that identify questions and possible 
responses. The method includes sending one of the different 
sets of data to different network computers for presentation of 
the question and possible responses and user selection of at 

30 least one of the possible responses. The method also includes 
receiving from the different network computers data identifying 
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user selections of at least one of the possible responses of the 
one of the sets of data. 

Embodiments may include one or more of the following 
features. The method may include sending to different network 
computers a different one of the sets of data for presentation 
of the identified question and possible responses and user 
selection of at least one of the possible responses. The method 
may further include receiving from the different network 
computers data identifying user selections of at least one of 
the possible responses of the different one of the sets of data. 

The method may further include providing a user interface 
for user submission of a question and possible responses and/or 
a user interface for user selection of a response to a question. 
The network may be the Internet . 

The method may further include selecting a set of data for 
sending to a network computer. The selecting may be performed 
based one characteristics associated with a user operating the 
network computer (e.g., age, gender, income, location, and/or 
one or more question categories of interest) and characteristics 
associated with the set of data (e.g., question category, 
characteristics of a desired user audience, and a presence of 
one or more keywords in the set of data) . The selecting may 
limit presentation of a set of data, for example, based on a 
number of responses to other questions provided by a submitter 
of the set of data. 

The method may further include transmitting data associated 
with an advertisement to the different network computers. The 
method may further include selecting the advertisement. The 
method may further include receiving data associating the 
advertisement with a set of data. 

The method may further include generating a report from the 
user selections received from the different network computers. 
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For example, the report may show the distribution of responses 
selected by users for a question. Generating the report may 
include determining one or more correlations between 
characteristics associated with the set of data, characteristics 
5 of the user selections, and/or characteristics of users 

selecting responses (e.g., the time of response and an amount of 
time responses to a question were considered) . 

The method may further include receiving data associating 
different sets of data. Such data may identify a next set of 
10 data to present after user selection of one of the possible 
responses of a set of data. 

The identification of a question may include text, an 
t image, a sound, and a link. Similarly, identification of a 
O possible response may include text, an image, a sound, and a 
% 15 link. 

ry In qeneral, in another aspect, the disclosure describes a 

Q method of collecting user responses to multiple-choice questions 

over the Internet. The method includes providing a first user 
W interface for user submission of a question and multiple-choice 
U20 responses for display via a web-browser and receiving different 
F? sets of data from different network computers presenting the 
first user interface. Individual ones of the sets of data 
include identification of a question and different multiple- 
choice responses to the question. The method also includes 
25 sending the sets of the data to different network computers and 
providing a second user interface for web-browser presentation 
of the question and multiple-choice responses identified by the 
sets of data via a web-browser. The method further includes 
receiving from the different network computers data identifying 
30 user selections of one of the multiple-choice responses 
identified by the different sets of data. The method 
additionally includes generating a report from the user 
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selections received from the different network computers, the 
report including a distribution of responses selected by users. 

In general, in another aspect, the disclosure describes a 
computer program product, disposed on a computer readable 
5 medium, for collecting user responses to questions over a 
network. The program includes instructions for causing a 
processor to receive from different network computers different 
sets of data identifying a question and possible responses to 
the question. The instructions also cause the processor to send 
10 to different network computers one of the different sets of data 
for presentation of the question and possible responses and user 
selection of at least one of the possible responses. The 
£ instructions also cause the processor to receive from the 
5 different network computers data identifying user selections of 
% 15 at least one of the possible responses of the one of the sets of 



data. 



: Brief Description of the Drawings 

hj FIG. 1 is a screenshot of a user interface that receives 

[J 20 user input specifying a question and a set of possible 



responses . 



FIG. 2 is a screenshot of a user interface that receives 



user input responding to a question. 

FIG. 3 is a screenshot of a report of question responses. 



25 FIGs. 4-6 are diagrams illustrating operation of a network 



polling system. 

FIGs. 7-9 are flowcharts of network polling processes. 
FIGs. 10-12 are screenshots of an administration user 



interface . 



30 



Detailed Description 
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FIGs. 1 to 3 illustrate user interfaces provided by a 
system that enables users to conduct their own polls of network 
users. In more detail, the system enables users to submit a 
question and a set of possible responses. The system presents 
5 the submitted question and possible responses to other network 
users and can tabulate responses to the question. Since many 
users enjoy responding to questions more than they enjoy asking 
them, submitted questions often accumulate a large sampling of 
responses in short order. 
10 While the system can provide an informal, anonymous forum 

for posing questions to other network users, the system can also 
offer businesses and organizations a variety of commercially 
£ valuable features. For example, by submitting a marketing 
O survey question, a business can quickly glean the preferences of 
5 15 consumers on the Internet. 

fU In greater detail, FIG. 1 shows a user interface 100 that 

yj enables a user to submit a question 102 and a set of possible 
f a responses 104-108. For example, as shown, the interface 10 0 
W receives user input asking "What is your favorite holiday 

20 special?" 102 and specifying a set of three different possible 
responses: "It's a Wonderful Life" 104, "How the Grinch Stole 
Christmas" 106, and "A Charlie Brown Christmas" 108. The system 
presents this question 102 and responses 104-108 to other 
network users. 

25 The system need not restrict the subject matter of the 

questions. For example, users can submit advice requests, 
opinion polls, trivia tests, and jokes. In other embodiments, 
the system may filter submitted questions and responses for 
objectionable content and reject the question or restrict access 

30 to a suitable audience. 

As used herein, the term "question" does not require a 
sentence including a question mark or other grammatical indicia 
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of a question. Instead, the term "question" merely refers to 
text, or other presented information, prompting the possible 
responses. For example, instead of asking a question, a user 
may omit a portion of a statement and include a set of possible 
5 responses for a "fill-in- the-blank" style question. Similarly, 
a user may submit a statement along with a set of possible 
responses representing reactions to the statement. 

In addition to specifying a question 102 and a set of 
possible responses 104-108, the user interface 100 may also 
10 collect criteria (not shown) specifying the audience for the 
question. For example, a user submitting a question 102 may 
specify a category of "Sports" or "Politics". Other users may 
t choose to respond to questions belonging to a particular 
5 category. Similarly, a question 102 may specify user 
J 15 characteristics. For example, question 102 criteria may specify 
a responding audience of male users between specified ages. The 
system may only pose the question or tabulate responses for 
users fitting the criteria. 

As shown, the user has provided a set of three, discrete 
20 possible responses 104-108. A user can provide as few as two 
possible responses such as "True" and "False" . Additionally, a 
user interface may collect more than three possible responses. 

As shown, a user can define the question 102 and set of 
possible responses 104-108 as text. The text can correspond to 
25 different languages (e.g., English, French, Spanish, etc.). In 
other implementations, users may submit graphics (e.g., images 
corresponding to American Sign Language) , animation, sound, 
programs, and/or other information for presentation as the 
question 102 and responses 104-108. Questions 102 and responses 
30 104-10 8 can also include links to other Internet sites. 

The system can permit a user to build a chain of questions. 
For example, the response (s) selected by a user may be used to 
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select the next question to be presented. This can be 
implemented in a variety of ways. For instance, a user can 
associate a question identifier with a particular response. 
When a user selects the response, the system receives the 
5 question ID and can present that question next. 

To encourage users that submit questions also to respond to 
questions submitted by others, the system may limit the number 
of responses collected for a question based on the number of 
responses to questions provided by the submitter. For example, 
10 if a user submitting a question responds to four questions 
submitted by other users, the system may present the user's 
question four times. The limit need not be determined by a 
t strict "one for one" scheme. Additionally, as described below, 
O users may purchase responses to their question in lieu of 
*S 15 responding to questions of others. 

HO FIG. 2 shows a user interface 110 presenting a submitted 

y question 112 and corresponding possible responses 114-118. To 

respond, a user selects from the set of possible responses 114- 
!TJ 118, for example, by "clicking" on a radio-button control 
U 20 presented next to a response 114-118. Other user interface 
P techniques may be used instead of a radio-button control. For 

example, each possible response may constitute a hyperlink 

having associated information identifying the response. 

Additionally, responses that can accept a range of values may 
25 feature a "slider", entry field, or other user interface 

widgets. Further, the user interface may process input from a 

wide variety of sources such as a speech recognition system and 

so forth. 

After a user submits a response, the system can select and 
30 present another question. This enables users to rapidly respond 
to one question after another. Many users find the process of 
responding to the wide variety of submitted questions both 

20/483458.1 - 7 - 



entertaining and somewhat addictive. Some users answer hundreds 
of questions in a relatively short time span. To keep the 
attention of such highly active users, the system can ensure 
that a user never encounters the same question twice. Because 
5 users may have submitted a question of their own, they may be 
more inclined to answer questions honestly, in hope of good 
faith within the community of users. It is also possible to pay 
the users, in money or some other currency of value, for their 
responses . 

10 In some embodiments a user can select more than one answer 

or enter information such as a score for different possible 
responses 114-118. For example, a question may ask a user to 
tJ rank different responses 114-118. 

6 As shown, in addition to the question 112 presented, the 

% 15 user interface 110 may also present information 130 about the 
W user submitting the question or other characteristics associated 
Q with the question (e.g., category). For example, as shown, the 
u user interface 110 presents the age and gender of the submitter, 
[y The user interface 110 shown in FIG. 2 may also include 

II 20 advertising such as a banner ad (not shown) . A user submitting 
p a question can supply and associate a particular ad with a 

particular set of question/ response data. Alternatively, the 
system may determine an advertisement for presentation, for 
example, based on user characteristics, keywords included in the 
25 question 102 and responses 104-108 presented, previous 

responses, and so forth. Additionally, the possible responses 
or questions themselves may form advertisements. For example, a 
question may include Microsoft's slogan "Where do you want to go 
today? " . 

30 Again, in some embodiments, the number of responses 

collected, or reported, for a submitted question depends on the 
number of responses provided by the submitter. As shown, the 
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user interface 110 can notify 132 a user of the number of 
questions answered thus far. The user interface 110 can also 
indicate 134 how many unanswered questions remain in a 
repository of submitted questions. 
5 FIG. 3 shows a user interface 12 0 that reports a 

distribution 124-128 of responses collected for a question 122. 
The system may limit access to such a report to the user who 
submitted the question 122. Alternatively, the system may make 
the report more freely available, for example, to allow users to 
10 see how their response compares to the responses of others. 

The system may provide more complex reports than the simple 
distribution shown in FIG . 3. For example, a report may 
t breakdown responses by user characteristics (e.g., age and 
5 gender) and/or other information such as the time of day the 
% 15 system received responses, the length of time users spent on the 
W question, and so forth. Additionally, the system may provide 
2 other analyses such as the statistical significance of the 
L distribution. Analysis techniques such as collaborative 
Tu filtering may also be used to provide predictive power with 
u 20 regard to answers that individuals are likely to give, based on 
U. their response history. 

Other analyses such as data mining can glean further user 
information. Such data mining can determine and report 
correlations between characteristics associated with a set or 
25 sets of question/response data, characteristics of the user 
selections, and/or one characteristics of users selecting 
responses. As an example, data mining may report a correlation 
between the gender of a user, the time of day, and a particular 
response to a question. 
30 FIGs. 1-3 depict a client web-browser, such as Microsoft® 

Internet Explorer®, presenting the user interfaces 100, 110, 
120. The user interfaces 100, 110, 120 may be encoded in a wide 
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variety of instruction sets/data. For example, the user 
interface may be encoded as HTML (HyperText Markup Language) 
instructions or other SGML (Structured Generalized Markup 
Language) instructions. The user interface 100 may also include 
5 instructions such as ActiveX components, applets, scripts, and 
so forth. 

FIG. 4 illustrates an architecture 20 0 for implementing a 
network polling system. As shown, the architecture 200 includes 
a server 218 that communicates with clients 202, 204 at 
10 different network nodes over a network 216 such as the Internet 
or an intranet. Such communication may comply with HTTP 
(HyperText Transfer Protocol) , TCP/IP (Transfer Control 
|r Protocol/Internet Protocol) , and/or other communication 
O protocols. 

"jf 15 The server 218 includes, or otherwise has access to, 

W storage 222 such as an SQL (Structured Query Language) or 

iff 

2 Microsoft® Access® compliant database. As shown, stored 
L information includes question information 224 such as the 

RJ submitted questions and their corresponding possible responses, 
yi 20 identification of the submitting user, responses received thus 
P far, the time of such responses, IP (Internet Protocol) address 

of a responding client, and so forth. The stored information 
may also include user characteristics 22 6 such as a username and 
password for each user. The user characteristics 22 6 may also 
25 include demographic information such as the age, gender, income, 
and/or location of a user. In general, the system can save a 
record detailing (e.g., identifying the user, time of day, user 
session ID, and so forth) each event that occurs (e.g., user 
login, question submission, presentation, and responses) . 
30 As shown, the server 218 includes instructions 22 0 for 

communicating with the clients 202, 204. For example, the 
server 218 may include Apache® web- server instructions that 
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determine a URI (Universal Resource Indicator) requested by an 
HTTP (HyperText Transfer Protocol) request and respond 
accordingly. For example, in response to a received URI of 
"www.abcdecide.com/submitquestion," the server 218 may transmit 
5 the form shown in FIG. 1. Similarly, in response to a received 
URI of "www.abcdecide.com/respond," the server 218 may transmit 
the user interface shown in FIG. 2. The server 218 may also 
include CGI (Common Gateway Interface) and/or Perl instructions 
for processing information received from the clients 2 02, 204. 
10 The instructions 22 0 also include polling logic. That is, the 
instructions 22 0 can store the submitted question, select a 
question for presentation to a user, process a received response 
t to a question, and so forth. 

□ As shown in FIG. 5, the architecture 200 enables users at 

£ 15 different clients 202, 204 to submit questions and possible 
W responses to the server 218. For example, the server 218 may 

•-ITS 

hj transmit user interface instructions for a form, such as the 

form shown in FIG. 1, that enables a user to specify a question 
Py and a set of possible responses. The user interface 
u 20 instructions transmit the collected information 2 06, 2 08 back to 
O the server 218, for example, as URI parameters (e.g., 
u www.abcdecide.com/cgi/?question=What is your favorite 
color+?responsel=red+?response2=blue+?response3=green) . Again, 
the server 218 can store the received question and possible 
25 responses along with other information such as identification of 
a user submitting the question, the time of submission, a 
session ID of the user submitting the question, and so forth. 

Before the server 218 allows a user to submit a question, 
the server 218 may request submission of user information, for 
30 example, identifying a username, password, age, gender, zipcode, 
and so forth. The user can use the username and password to 
identify the user to the server 218, for example, at a later 
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session, potentially, initiated at a different network computer. 
The system can request contact information (e.g., an e-mail 
address) from users if they would like to be notified of certain 
events, such as when their submitted question has received a 
5 requested number of answers. 

As shown in FIG. 6, the server 218 can select and present a 
submitted question 230 to a user operating a client 202. For 
example, as shown, the server 218 selected a question submitted 
by a user operating client 204. The server 218 can select a 
10 question, for example, based on a question category identified 
by a user responding to questions. 

The server 218 can select questions such that a user does 
fcr not answer the same question twice. For example, each question 
5 may receive an identifier generated by incrementing a question 
4 S 15 counter. In such an embodiment, the server 218 can select a 
W question to present to a user by determining the identifier of 
Lit the last question answered by the user and adding one. The 
'j server 218 may store the identifier of the last question 
fU presented in the database of user information 22 6. This enables 
U 20 the server 218 to determine the most active users. This 
P information can enable the system to produce a report that 

isolates responses of the most active users. Alternatively, the 
server 218 may store a "cookie" at a user's client that includes 
the identifier of the last question presented. 
25 Similarly, the system may ensure that user does not have to 

answer questions that he himself posed. For example, the system 
can compare the username associated with the current session 
with the username of the user that originally submitted the 
question. 

30 When selecting a question, the server 218 may skip 

questions where the user does not satisfy question criteria 
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specified by a question submitter. Similarly, the server 218 
may skip a question to limit the number of responses collected. 

After selecting a question to present to a user, the server 
218 can dynamically construct a user interface including the 
question and the question's set of possible responses. For 
example, the server 218 may include PHP (Personal Home Page) 
instructions that dynamically generate HTML (HyperText Markup 
Language) instructions. The server 218 can then transmit the 
generated instructions to the user's client 202. 

In another embodiment, instead of dynamically generating 
instructions for each question at the server 218, the user 
interface instructions transmitted to a client may include an 
applet that communicates with the server 218, for example, using 
JDBC (Java Database Connectivity) . The applet can transmit a 
response to the current question and query the server 218 for 
the next question. The applet then reconstructs the screen 
displayed by the user interface to present the next question. 
Other embodiments feature a Java servlet which is run when a 
user accesses the service. Other techniques for handling 
client /server communication over the Internet are well known in 
the art and may be used instead of the techniques described 
above . 

FIGs. 7-9 are flowcharts of network polling processes. 
FIG. 7 depicts a flowchart of a process 240 for receiving 
questions submitted by users. As shown, the process 240 
receives information specifying a question and a set of possible 
answers. For example, the process 240 may transmit user 
interface instructions, such as the form shown in FIG. 1, that 
receive and transmit user input over a network. The process 240 
stores 244 the received question and possible responses along 
with questions and possible responses received from other users. 
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The process 240 may limit the number of active questions a 
particular user may submit. 

FIG. 8 depicts a flowchart of a process 250 for collecting 
and tabulating responses to submitted questions. As shown, the 
5 process 250 selects 252 a question from the different questions 
submitted by different users. The process 250 transmits 254 the 
selected question and possible responses to a network client. 
The process 250 then receives 256 and stores 258 the user's 
response. The process 250 can repeat 260 depending on the 
10 number of questions the user chooses to answer. 

FIG. 9 depicts a flowchart of a process 2 70 for limiting 
the number of responses collected and/or reported for a 
£ submitted question. As shown, after a user submits 272 a 
3 question, the process 270 presents questions submitted by 
S 15 others. Each response to a question submitted by another 

* increments 276 the number of responses collected and/or reported 

Q 

m for the user's submitted question. 

If a user has more than one outstanding question the system 
may distribute the responses collected and/or reported across 
20 the different questions. For example, the system can increment 
the number of responses collected for the most recently received 
question. Alternatively, the user can identify which of the 
various outstanding questions is incremented. As yet another 
alternative, the system can spread responses evenly across each 
25 outstanding questions. 

The system as described and shown has a wide variety of 
potential applications. For example, the system may simply be 
an entertaining diversion for web-surfers. The system, however, 
can also provide valuable marketing information. For example, 
30 the system may use the user's identity, questions posed and 

responses given, as well as other accessible information (e.g., 
life habits based on accessing times of the site) to discover 



Q 
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correlations, for example, all answers to questions that have 
ever involved a certain keyword, all answers given by a single 
user, demographic breakdowns of site access time, and so forth. 
Instead of analyzing the data, the information collected 
5 may be provided to market researchers for their own 

determination of trends and consumer attitudes. Since the 
system can enable users to select their own username, making 
such information available need not compromise the anonymity of 
users responding to questions. 
10 The system may also receive questions on behalf of 

commercial clients. This enables commercial clients to conduct 
their surveys unobtrusively. A survey question from a 
commercial client can appear in the midst of questions submitted 

o 

5 by non-commercial users. The questions of the commercial client 
*2 15 can escape detection as market research and, potentially, avoid 
rJ problems associated with more traditional market research such 
hi as the bias introduced when a consumer knows they are subject of 
* a marketing effort. In addition to candid responses, the system 

?U can provide commercial clients access to a large, diverse user 
U 20 base and can enable the clients to conduct rapid surveys that 
O yield highly-relevant (e.g., demographically targeted) and cost- 
effective results (e.g., small fee per response). 

Site administrators may charge commercial clients for 
responses. For example, a commercial client may purchase a 
25 specified number of responses to a question for a fee. 

Alternatively, a commercial client may purchase a "time period" 
for the system to collect responses. The administrators may 
also enable specification of the position the questions is 
presented. For example, a commercial client may pay to have 
30 their question presented within the first four presented to each 
user or to have their questions presented in a particular order 
or separated by a specified number of other questions. 
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FIGs. 10-12 illustrate screenshots of a network-based tool 
for system administration. The tool enables an administrator to 
view results, access and manipulate stored information, test 
system features, masquerade as a particular user, and so forth. 
5 As shown in FIG. 10, the tool permits an administrator to submit 
SQL commands and queries to retrieve and modify stored 
information. For example, as shown a user has entered a "show 
tables" command into the SQL window. FIG. 11 shows the results 
of this command. As shown in FIG. 12, the tool can also present 
10 an administrator with a list of questions asked, how many 
responses have been received, and so forth. 

In other embodiments, the system may offer functionality by 
£ which different kinds of users, (e.g., administrators, power 
5 users, guests, etc.) may perform different, more elaborate or 
l ~ 15 simpler, queries, or pose different kinds of questions (e.g., 
W with different numbers of possible responses) , manipulate stored 
JJ information (e.g., information about other users, etc.) and so 
*, forth. 

ry The system may also provide games and other elaborations, 

SS :; 

yf 20 for example by keeping score, or by enabling users to predict 
Q the results that their questions will receive, or by giving out 
awards or prizes for satisfying various criteria. 

The system can automatically generate questions and pose 
them through the service, and then proactively offer the results 
25 to a company. For example, a question might be "Which N do you 
prefer?" and three responses "X" , U Y" , and "Z" , with N being a 
category like "web browser" and X, Y, and Z being examples of 
that category - "Microsoft® Internet Explorer®", "Netscape® 
Navigator®," "neither." The content for these automatically 
30 generated questions could be derived from a variety of sources 
(e.g., a database, a software- selling web site with product 
categories and specific products listed in an accessible 
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format) . Various entities might be interested in this data 
(e.g., the software seller, the makers of the products, market 
researchers and so forth) . 

While illustrated as a web-based system, the techniques 
5 described herein may be used with a wide variety of 

communication networks and devices such as WAP-enabled (Wireless 
Applications Protocol) devices, PDAs (Personal Digital 
Assistants), wearable computing devices, and so forth. 

The techniques described herein are not limited to a 
10 particular hardware or software configuration; they may find 
applicability in a wide variety of computing or processing 
environments. The techniques may be implemented in hardware or 
software, or a combination of the two. Preferably, the 
Q techniques are implemented in computer programs executing on 
r 15 programmable computers that each include a processor, a storage 
fU medium readable by the processor (including volatile and non- 
M volatile memory and/or storage elements) , at least one input 
:. device, and one or more output devices. 

SSSSi 

rij Each program is preferably implemented in high level 

20 procedural or object oriented programming language to 
O communicate with a computer system. However, the programs can be 
implemented in assembly or machine language, if desired. In any 
case the language may be compiled or interpreted language. Each 
such computer program is preferably stored on a storage medium 
25 or device (e.g., CD-ROM, hard disk, or magnetic disk) that is 
readable by a general or special purpose programmable computer 
for configuring and operating the computer when the storage 
medium or device is read by the computer to perform the 
procedures described herein The system may also be considered 
30 to be implemented as a computer- readable storage medium, 

configured with a computer program, where the storage medium so 
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configured causes a computer to operate in a specific and 
predefined manner. 
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